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Abstract. The primary objective of this work is to develop coarse-graining schemes for stochas- 
tic many-body microscopic models and quantify their effectiveness in terms of a priori and a pos- 
teriori error analysis. In this paper we focus on stochastic lattice systems of interacting particles 
at equilibrium. The proposed algorithms are derived from an initial coarse-grained approximation 
that is directly computable by Monte Carlo simulations, and the corresponding numerical error 
is calculated using the specific relative entropy between the exact and approximate coarse-grained 
equilibrium measures. Subsequently we carry out a cluster expansion around this first-and often 
inadequate-approximation and obtain more accurate coarse-graining schemes. The cluster expan- 
sions yield also sharp a posteriori error estimates for the coarse-grained approximations that can be 
used for the construction of adaptive coarse-graining methods. We present a number of numerical 
examples that demonstrate that the coarse-graining schemes developed here allow for accurate pre- 
dictions of critical behavior and hysteresis in systems with intermediate and long-range interactions. 
We also present examples where they substantially improve predictions of earlier coarse-graining 
schemes for short-range interactions. 
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1. Introduction. In the recent years there has been a growing interest in devel- 
oping and analyzing hierarchical coarse-graining methods for the purpose of modeling 
and simulation across scales for systems arising in a broad spectrum of scientific 
disciplines ranging from materials science to biology and atmosphere/ocean science. 
Typically in microscopic simulations of complex systems the model is formulated 
in terms of simple rules describing interactions between small-scale degrees of free- 
dom such as individual particles or spin variables. On the other hand computational 
difficulties arise immediately from evaluating their interactions for any realistic size 
spatio-temporal scales. When a coarse-grained model becomes available, it has fewer 
observables than the original microscopic system making it computationally more effi- 
cient than the direct numerical simulations. At the same time it is expected that it can 
describe accurately the unresolved degrees of freedom. The coarse-graining strategy 
we are pursuing here is attempting to address these goals in the context of equilib- 
rium sampling of stochastic lattice systems by combining methods from statistical 
mechanics and perturbation analysis. 

In this paper we consider stochastic lattice systems such as Ising-type models 
as a paradigm of hierarchical coarse-graining that can provide an explicit numeri- 
cal method with prescribed error tolerance. Such lattice systems for N particles are 
defined in terms of a microscopic lattice Hamiltonian H^icr) with a being the mi- 
croscopic configuration and an a-priori Bernoulli measure PN(d<j). We perform a 
coarse-graining by subdividing the lattice into coarse cells and defining variables rj on 
each coarse cell to be the total magnetization in the cell. The corresponding renor- 
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malization group map (known as the KadanofF transform) [71 112) is defined by the 
formula 

where Hm{ti) is the Hamiltonian at the coarse level and Pjvl'^o'l'?) is the conditional 
probability of having a microscopic configuration a given a configuration 77 at the 
coarse level. 

Such a Hamiltonian defined on a coarser level than the microscopic, is an exact 
equivalent of the microscopic Hamiltonian Hn, in the sense that the finer degrees of 
freedom have been averaged. However, it cannot be easily calculated explicitly and 
hence used in numerical simulations. Our perspective is to approximate it by viewing 
it as a perturbation of a coarse-grained approximating Hamiltonian H^^j' suggested 
in ^1 and defined by 

H^Mv) = J HN{cj)PN{da\ii). 

A closely related coarse-grained Hamiltonian was suggested independently in [TUIITT] . 
where it was constructed in an equilibrium context using a wavelet expansion. 
Using this first approximation we have 

The fact that the conditional probability PN{da\ri) factorizes at the level of the coarse 
cells allows us to use cluster expansion techniques to write a series expansion for 
HM(ji) around H'fj. We obtain the following series 

HMiri) = H^hv) + H^h^) + ■■■ + H^Miv) + 0{eP+') , p = 2, . . . (1.1) 

uniformly in rj, where the correction terms H^^j\rj), H'^j\'r]) etc. can be calculated 
explicitly with the relevant errors and e is a small parameter depending on the char- 
acteristics of the coarse-graining, the potential and the inverse temperature. In this 
paper we first show that this strategy works well provided that the interactions have a 
range which is long compared to the size of the coarse cells and that they vary slowly 
over the size of a coarse cell. The parameter e (given explicitly in (|2.2U|) ') encapsulates 
these conditions. 

Notice that we do not perform the usual high-temperature expansion using the 
Bernoulli product measure Pjv (dc) but rather expand the Hamiltonian around a well- 
chosen first approximation using the product structure at the coarse level of the condi- 
tional probability PN{da\ri). This allows us to construct these approximating Hamil- 
tonians well-beyond the temperature range allowed in a standard high-temperature 
expansion. The basic tool for cluster expansions is the reformulation of the system 
in terms of what is called the polymer model. This technique originates from Mayer 
[T^ and Peierls 20 for the case of high/low temperature respectively. For the high 
temperature case, a first rigorous proof was given in while our approach is based 
on the polymer system introduced in 0. For an overview of these methods and 
references we refer to |23j . 

Clearly the choice of the first approximation is crucial to our method and it 
should be such that (i) it is explicitly computable as the constructions in |lU[ll3j . and 
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(ii) it provides a good estimate between the microscopic and the 2nd-order coarse- 
graining. In a subsequent paper ^B] we wiU show how to apply these ideas and 
techniques to systems with both short and long-range interactions. In this case the 
choice of the first approximation h''^^ will not be given in a closed form but it will be 
computed numerically in an efficient way. 

All error estimates arc calculated in terms of the specific relative entropy of the 
corresponding equilibrium Gibbs measures. Specific relative entropy represents the 
loss of information in the transition from the microscopic to the coarse-grained models 
and here is used to assess the information compression for the same level of coarse 
graining in schemes that are of a higher or lower order, determined by the truncation 
level p in Hl.l(l . The primary practical purpose of the higher-order corrections is 
in allowing us to extend the regime of validity of the expansion and to obtain very 
accurate coarse grainings of the Gibbs measure even if the parameter e in is not 
necessarily much smaller than one. We refer to examples in Section [S] where even 
for e = we obtain an accurate prediction of the hysteresis when we include the 

higher-order correction terms. 

The error analysis developed in this paper also provides an error expansion that 
can be computed and tracked in the process of a simulation from the numerical data. 
Such an a posteriori error cannot be numerically computed directly from the relative 
entropy formula, since it involves the calculation of the probability density functions 
of the microscopic and the coarse-grained measure. However, the expansion in Hl.l(l 
shows a constructive way of calculating the error made, for instance, by the 2nd-order 
coarse-graining Hfj (jf) in terms of other coarse observables given by the higher- 
order correction terms h'^^j plus a controlled error of order 0{e^^^). Similarly to the 
numerical analysis of approximations for PDEs, we derive a priori and a posteriori 
error estimates between the exact microscopic solution and the approximating coarse- 
grained one. In contrast to the PDE setting where such error analysis is calculated in 
a suitable norm, here the error is measured in terms of the specific relative entropy. As 
in the case of PDEs such a posteriori errors are also useful for constructing adaptive 
methods. For some earlier work on adaptivity for stochastic systems see, e.g., pnEll24|. 

The paper is organized as follows: In Section El we present the main results and 
an outline of our methods. In SectionElwe discuss cluster expansions in the context of 
coarse-graining and derive the effective coarse-grained Hamiltonian as an abstract ex- 
pansion. In Section0]we calculate the first terms in the expansion of the Hamiltonian 
and formulate two concrete numerical schemes; Scheme l4. II is second-order accurate, 
while Scheme 14.21 is third-order accurate. In Section |S1 we present simulations with 
these schemes in a demanding phase transition regime. Appendix A includes the 
details of our analytical calculations in Section 0] Appendix B contains a brief de- 
scription of computational background for the Monte Carlo algorithms used in the 
sampling of microscopic and coarse-grained Gibbs states carried out in Sectional 
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supported by NSF-DMS-0306540. The research of D.T. was partially supported by 
NSF-DMS-0413864 and NSF-ITR-0219211. 

2. Main results and outline of the method. 

2.1. Microscopic models. We consider as the physical domain for the system 
the d-dimensional torus [0,1)'' with periodic boundary conditions. The micro- 
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scopic system consists of a uniform lattice Ajy (-ZY'' D T^j. The number of lattice 
sites iV = n is fixed, but arbitrary and finite. We consider here periodic boundary 
conditions, but other boundary conditions can be accommodated easily. 

The spin (or order parameter) a{x) takes values in {+1,-1} at each lattice site 
X e Ajv. A spin configuration a = {a{x)}xeAN is an element of the configuration space 
Sn ■■= {+1,-1}^". The energy of the configuration a is given by the Hamiltonian 

hAt) = E E - vM^My) + E h{^M^) , (2.1) 

where the two-body inter-particle potential J describes the interaction between indi- 
vidual spins and h is an external field. 

The strength of the potential is measured by || J || = J2x^o i-^- assume 

that the two-body potential is summable. As we will scale later the Hamiltonian with 
the inverse temperature f3 we can assume, without loss of generality, that || J || = 1. 

Example 1: Nearest-neighbor interaction. In this case the spin at site x interacts only 
with its nearest neighbors on the lattice Aat, i.e. 



J{x-y) 



J \i\x-y\ = 
otherwise. 



Example 2: Finite-range interactions. A spin at site x interacts with its neighbors 
which are at most L lattice points away from x. It will be useful to consider the range 
of the interaction L as a parameter of the model. To do this let 

y:M+^R, y(r)=0, if |r| > 1. (2.2) 

Then the potential J(x — y) can be taken to have the form 

1/71 \ 

The factor \/L'^ in H2.3|l is a normalization which ensures that the strength of the 
potential J is essentially independent of L and we have || J || ~ J \V{r)\dr. Note also 
that Example 1 can be obtained from Example 2 by setting L — 1. 

Example 3: Long-range interactions. In this case we assume that a spin interacts 
with all spins on the lattice A^r via a summable interaction J{x). Since our goal is 
to construct coarse-grained approximations of the Hamiltonian suitable for numerical 
simulations it will be convenient to truncate long-range interactions and control the 
error term. In order to do this we choose a small parameter S and choose L such that 

E \Ji^)\<^- 

{x : \x\>£^} 

The parameter L can be thought as the effective range of the potential and we can 
truncate the long-range potential J(x) by setting J{x) = if |a;| > ^. If we denote 
by J the truncated potential and by Hn the corresponding Hamiltonian it is easy to 
see that 

l\HN{<j)~HN{<y)\ = 0{S). 
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i.e., the error per unit volume is of order 6. We can then assume that the truncated 
potential has the form H2.3|l . 

Example 4- Kac-type interactions. Mean-field interactions are obtained formally by 
taking a finite range interaction and setting L = n in (|2.3|l 

J{x^y) = ^Vi\x-y\) , x,yeAN. (2.4) 

Note that this is different from a summable long-range interaction since the potential 
is scaled with the size of the system. 

The potential in Example 2 will be central to our analysis. Both Example 1 
and 4 are obtained in suitable limiting cases (L — 1 and L = n respectively) and 
the potential in Example 3 can be approximated by such potentials (see the error 
estimates below). 

The finite-volume equilibrium states of the system are given by the canonical 
Gibbs measure 

mAd'j) = ^e-^^"(")Pjv(da) , (2.5) 

where P is the inverse temperature, Zn is the normalizing partition function, and 
P]\r{da), the prior distribution on Sn, is the product measure 

PNida) = II p{da{x)). 

A typical choice p{cr{x) = +1) = ^ and p{<t{x) = —1) = ^ is the distribution of a 
Bernoulli random variable for each x € An. 

2.2. Relative specific entropy. One of the obvious issues arising in any at- 
tempt to coarse-grain microscopic systems is the evaluation of the numerical error as 
we move from finer to coarser scales. This error essentially involves the comparison 
of the microscopic and the coarse-grained probability measures. A natural way to 
compare two probability measures is to compute their relative entropy. Let tti (ct) and 
7r2(cr) be two probability measures defined on a common probability space, with the 
state space S. The relative entropy, or KuUback-Leibler distance, of tti with respect 
to 7r2, is defined as 

7e(^ik2) = £log(^^^d^i, (2.6) 

where dni / d'!i2 is the Radon- Nikodym derivative of tti with respect to 7r2 , On a count- 
able state space S we obtain 

7e(^i|7r2) = ^7ri(a)log^. 

In information theory the relative entropy TZ{tti \tt2) provides a measure of "infor- 
mation loss" or "information distance" of tti compared to 7r2. In our context we 
use the relative entropy in order to assess the information compression of different 
coarse-graining schemes. Basic properties and applications in information theory can 
be found in 
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Using Jensen's inequality it is not difBcult to show that 
7?. (tti 1 7r2) > and, 

TZ (tti 1 112) — if and only if 7ri((7) ~ 7r2((T) for all cr G iS. 

TZ (tti 1 7r2) = 00 if TTi is not absolutely continuous with respect to 1^2 ■ 

The relative entropy is not a metric (it is not symmetric), but one can use the rel- 
ative entropy to bound the total variation distance of the measures tti and 712 as 
demonstrated by Csiszdr-Kullback-Pinsker inequality (J^) 

^^iK2)>^(^^ki(a)-7r2(a)|^ = i - ^2 ||^v , (2-7) 
or equivalently using the dual form of the total variation norm 



< (tti |7r2), (2.8) 

where || • ||oo denotes the usual sup- norm. 

In statistical mechanics, the entropy, which is the relative entropy with respect 
to the prior distribution, and the relative entropy play a prominent role, in particular 
in the variational principles. The relative entropy is, in general, difficult to compute 
since it requires the sampling of the probability distribution 771(17) and 772(0") which 
can be prohibitively expensive if the dimension of the state space is large. For Gibbs 
measures it is, however, a little simpler in the sense that it depends only on the 
partition functions and the expected values of the Hamiltonian. Consider, for example, 
two Gibbs measures /ij^^^ and /xj^'^ with Hamiltonians i?^'' and i?^'' and partition 
functions and -^^^ Then we have 

^ (mS, I - log + / - H^^^) . (2.9) 

Note that the Hamiltonians and the logarithm of partition functions are extensive 
quantities: they are proportional to the size of the system N . The formula (|2.9|l shows 
that the entropy of a Gibbs measure and the relative entropy of a Gibbs measure with 
respect to another Gibbs measure are also extensive quantities. It is therefore natural 
to compare two Gibbs measures on iS^v by computing their specific relative entropy 




The specific relative entropy is a measure of the information loss per unit volume and 
will be our main estimation tool in this paper. A simple example were this interpreta- 
tion is evident arises if one considers N independent particles and the ensuing scaling 
of the collective discrepancy if an individual error is committed on the observation of 
each particle. 

2.3. Coarse-grained models. The coarse-graining procedure consists of three 
steps that we describe separately. 

(a) Coarse graining of the configuration space. We partition the torus into M = m'^ 
cells: For fc = (fci, . . . , ka) G Z"^ with < fc^ < m - 1 we define = ■^) x ■ • • x 
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fe' ^^'^ ^® have Trf = UfcCfe. We identify each cell Ck with a lattice point of 

the coarse lattice Am = {-^"^Y ^ "^d- Each coarse cell contains Q ~ q'^ points of the 
microscopic lattice points with N = n''' = {mq)'^ = MQ. We will refer to Q as the 
level of coarse graining (Q = 1 corresponds to no coarse graining). 

We assign a new spin value r]{k) for the cell Ck according to the rule 

V{k) = ^(^) • 
xeCk 

The spin r]{k) takes values in {—Q, —Q + 2, . . . ,Q} and the configuration space for 
the coarse grained system is Sm = {—Q, —Q + 2, . . . , Q}^" . We denote by F the map 

F : Sn ^ Sm , cr '-^ { ' 
xeCk 

which assigns a configuration r] = {v{k)}k&AM coarse lattice given a configu- 

ration a = {a{x)}xeAN- equivalent coarse grained variable, which we shall also 
use later, is 

a{k) := card {a; € Ck ■ <t{x) = +1} 

which takes values in {0, 1, ... , Q}. Both coarse variables are equivalent and they are 
related by the transformation t] = 2a — Q oi a = ^^^^ . 

(b) Coarse-graining of the prior distrihution. The prior distribution Pjv on Sn induces 
a new prior distribution on Sm given by Pm — Pn ° F^^, i.e., 

Pm(??) = Pjv(a : F(a) =7?). 

Since rj{k) depends only on the spin (j{x), with x £ Ck, the measure Pm is a product 
measure 

PM{dv)= n piMk)), 

keAM 

with 

Q 



The conditional probability PN{d(T\r]) plays a crucial role in the sequel. Since 
r]{k) depends only on the spin a{x) with x e Ck, the probability PN{da\r]) factorizes 
over the coarse cells. We have 

PNidalr,) = ^^(^n(F(.)=,}) ^ ^ ^^^^^^^^^^ ^^^^^ 

keAm 

and pk,ri{k){do') depends only on {a{x)}xeCk- In particular we have 

f t \ 1^ V{k) + Q , . -,^ Q-v{k) , . 

P/c,r,(/c) (o- W = 1) = — 2Q — ^^'^ = -1) = — 2Q — " ^ ' 



8 



M.A. Katsoulakis, P. Plechac, L. Rey-BcUot, D. K. Tsagkarogiannis 



To simplify the notation and because our estimates are uniform in ri(k) we denote this 
measure simply by p^- For a function / = /(c) we define the conditional expectation 



= I f{<j)PNida\^) = / f{'y)PNida) 

= J fia)llpkida). (2.12) 



(c) Coarse-graining of the Hamiltonian. We want to construct a Hamiltonian HMiji) 
at the coarse-level. A natural definition of such Hamiltonian, as we explain below, 
is given by the renormalization group block averaging transformation (also known as 
Kadanoff transformation). 

Definition 2.1. The exact coarse grained Hamiltonian Hm{vi) is defined by the 
formula 

^-PHm(v) ^ E[e-'^^"|ry]. (2.13) 
Given the Hamiltonian Hm we define the corresponding Gibbs measure by 

mAdv) = -^e-^""^''^PM{dv) . (2.14) 

The factor (3 in front of HM{ri) is merely a convention, in general the Hamiltonian 
Hm(j]) does itself depend on /3 in a nonlinear, complicated way. 

Clearly for a fixed value of N, this transformation is well defined. However, 
from the point of view of statistical mechanics this is not sufficient. We want to 
construct the coarse-grained Hamiltonian HM{ri), for any A/, as a sum of (summable) 
many-body interactions. Our original Hamiltonian H^la) involves only one-body and 
two-body interactions but the nonlinear transformation H2.13II will not preserve this 
property. The Hamiltonian we will consider in the sequel will have the form 

Km{v) = E JiX,{m}kex) (2.15) 

where the J(X, {Tyfcj/jgx) are translation- invariant many-body interactions involving 
card(X)-many different sites. Such an interaction is said to be summable if 



E 

{x-.oex} 



^ ||J(X,{7]fe}fcex)|| < oo. 



It is well-known that the Kadanoff transformation suffers from some patholo- 
gies. At very low temperature the Kadanoff transformation for the nearest-neighbor 
Ising model with the zero magnetic field is not well-defined in the sense that the coarse- 
grained Hamiltonian Hm does not correspond to a summable interaction. These 
pathologies are relatively mild and can be eliminated by extending slightly the 
concept of Gibbs measures. For a comprehensive presentation of this issue see the 
review paper |25) or also ^ among others. Furthermore, these pathologies will not 
play any role in our analysis: the cluster expansion techniques we are using exclude 
the occurrence of these pathologies for the models and the values of the parameter 
we consider. 
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The exactness of the coarse graining in the KadanofF transform is expressed by the 
fact that the specific relative entropy of fiM,f3{dvi) with respect to the coarse-grained 
Gibbs measure /xjv./3 o vanishes. Indeed we have 

Zn = j e-f'"-^-'^PN{dcj)= J E[e-^"-\7j]PMidr,) 

e-P^-'i^) P^idi^) ^ Zm , (2.16) 

and consequently from (|2.13() . 

J {a 1 F(o-)=?j} 

and thus 

Even for moderately large values of N the exact computation of Hm(ti) is, in 
general, impractical. The coarse grained Hamiltonian involves not only two-body 
interactions, but also many-body interactions of an arbitrary number of spins. Our 
goal is to present a systematic way of calculating explicit approximations of the coarse- 
grained Hamiltonian Hm , to any given degree of accuracy. In the first step we define 
an approximate Hamiltonian H^(r]) and we give an a priori bound on the blocking 
error. The choice of H^j^ we make, following 1151, is given in the following definition. 

Definition 2.2. The first approximation H^^^ of the coarse-grained Hamiltonian 
Hm is given by the formula 

H^,\v) = E[Hn\v] . (2.17) 
In order to compute H'^\r]) we note that we have 

E[a(x)a(y)|r;] = ^^^, xeCk,yeCk. 



Then 



where 



2 ' 2 

k l^k k 



j{k~i) = E "^(^ - ' ^ ^ 

-^W^TTTTTrTT E Ji^-v)' for fc = /. 
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By defining H\j [if) one replaces the potential J{x — y) by its average over a 
coarse cell. Thus the error for the potential is proportional to 

Eki{x - y) := J(x - y) - J{k,l) , x £ Ck,y e Ci , 

which measures the variation of the potential J{x — y) over a cell. An estimate on 
the error is provided by the following lemma 

Lemma 2.3. Assume that J satisfies H2.2I) ~ (I2.3|I and assume that Vir) is . 

1. There exists a constant C > such that, if x £ Ck and y € C/, we have 

\J{x-y)-J{k,l)\<2-^ sup ||V^^(x'-y')ll- (2.18) 

2. There exists a constant C > such that, ifF{a) — rj, we have 

<c|||vy|U. (2.19) 

The lemma will be proved in Subsection l3.2l Note that the estimates in Lemma|^31 
are not necessarily optimal and can be improved under suitable assumptions on the 
potential. The importance of Lemma IT^ lies in the identification of the small param- 
eter in Theorem 12 .41 below 

t = CI3^\\VV\U, (2.20) 

where C is some constant. Note that we included the inverse temperature (3 in the 
parameter, taking into account that (3 multiplies the Hamiltonian in the Gibbs mea- 
sure. The parameter e encapsulates the various factors involved in our coarse-graining 
method. 

(i) Coarse-graining cell size. The factor q/L in (|2.20|l indicates how the size of the 
coarse cell governs the effectiveness of the coarse-graining procedure. 

(ii) Slow variation of the potential. The factor ||Vy||oo in 12.201 indicates that the 
coarse-graining will be particularly effective even for large cell sizes if the potential 
V is slowly varying. This fact is exemplified by considering the extreme case of the 
Curie- Weiss model where J{x — y) — J \s independent oi x — y. It is easy to see that 
in this case the coarse-graining is actually exact. 

(Hi) Temperature. At high temperature, i.e, for small (3 the coarse-graining procedure 
will work well even for large values of q/L, i.e., for very large coarse cells or for 
potentials with very short range. This refiects the fact that at high temperature 
Gibbs measures are actually very close to product measures and that, trivially, product 
measures can be coarse-grained exactly. On the other hand our methods clearly do 
not apply to very-low temperatures. 

Let us denote by fl^^j ^{drj) the Gibbs measure 

-^''Udv) = -^e-^^'^'^^^PM{dv). 

From Lemma 12.31 we obtain immediately the bound 

l'Jl{flfl^\fiNj,oF-') = 0{e). (2.21) 



N 
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Furthermore, Lemma l3 . 2l allows us to perform a cluster expansion and compute higher- 
order corrections. The basic idea is to rewrite the exact coarse-graining as 

or 

Hm{ii) - Hf^{v) - ^logEie-^^^"^^)-^^''''))^] . (2.22) 

Note that the exponential in the second term is not necessarily small, it is in fact 
of order Ne. Cluster expansions are tools which allows to expand such quantities in 
convergent power series using the independence properties of product measures. The 
crucial fact here is that conditional measure PN{da\r]) factorizes over the coarse cells. 
The main result of our paper, proved in Section 01 is 

Theorem 2.4. Let us assume that J satisfies (|2.2|l -~ (|2.3|) and that V(r) is . 
Then there exists a constant > such that if 

S = Qe < So , 

the Hamiltonian HMiv) ca?i be expanded into a convergent series 

oo 
p=0 

where each term H^^j (rj) is a sum of finite-range translation invariant many-body 
potentials. The first few terms are explicitly calculated in Scheme \4.1\ and Scheme \4.!^ 
in Section^ We have the following error bounds uniformly in r/ and N 

I [Hm{v) - iH^i\v) + ■■■ + H'^hv)) - 0{e^+') . 
If we define the Gibbs measures 

then the following bounds for the relative entropy per unit volume hold 

l7^(/IS;^|Mw,;3oF-l) = 0{e^), 
l7^(/2g^|M^,0oF-l) = O(eP+l), 

where p = 2, . . . and e is given by l^2.2f)\) . 

We note that in information theory the relative entropy provides a measure of 
"information distance" of two probability measures. In our context we use the relative 
entropy estimate of Theorem l2.4l in order to assess the information compression of dif- 
ferent coarse-graining schemes. According to how many correction terms are included 
in the expansion corresponding to different truncation levels p, such as Scheme 14.11 
and Scheme 14.21 in Section 0] we quantify the amount of the information loss when 
the measures are compared at the same level of coarse graining. 

Remark 2.1. 
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1. The cluster expansion provides an explicit algorithm to compute the higher- 

~ (v) 

order approximations HjQ . For example, the next order correction is given 

by h'^j' + H^j^ as in Scheme l^^ in Section^ The analytical computations re- 
quired for determining higher-order corrections become quickly very involved, 
nonetheless they can be carried out with symbolic computational tools. 

2. The primary practical purpose of the higher-order estimates in Theorem 12.41 
is in allowing us to extend the regime of validity of the expansion and obtain 
very accurate coarse-graining of the Gibbs measure even if the parameter e 
given by (|2.2()|l is not necessarily much smaller than one. We refer to the 
examples in Sectional where even for q> L, and /3 > 1, i.e., e — 0(1), we get 
an accurate prediction of critical behavior when we include the higher-order 
correction terms. 

3. The reader might wonder about the appearance of a new small parameter 
5 ~ Qe in the statement of Theorem 12. 41 The reason lies in the details of the 
cluster expansion. Since the conditional measure P]^{da\r]) factorizes over 
the coarse cells, it is required for the cluster expansion to converge that the 
error in every coarse cell is small. The error for each site of the microscopic 
lattice is of order e and thus the error for a coarse cell is of order 6 = Qe. 

4. Note further that the bound (|2.23() improves on the bound H2.21|l and that 
shows the first approximation h'^j^ is actually already a second-order method. 
This is due to cancellations which follow directly from the definition of /f^"' , 
see Definition 12.21 and (|4.2|) below. 

In the previous theorem the errors are calculated with respect to the relative 
entropy of the corresponding equilibrium measures. Apart from this a priori estimate, 
we would also like to have a formulation of the error that can be explicitly computed, 
from the data of the simulation. In our case, such an a posteriori error cannot be 
numerically computed directly from the relative entropy formula, since it involves the 
calculation of the probability density functions of the microscopic and the coarse- 
grained measure. However, the error estimate of Theorem 12.41 provides us with an 
explicit way of calculating the error made, for instance, by the 2nd-order coarse- 
graining. In Section^we prove the a posteriori error estimate for 7^(/2^^^|/ijv,/3°F~^) 
given in the theorem 

Theorem 2.5 (A posteriori error). We have 

m'^Mf3\t^Nj3 o F-1) = E ,0, [i?(ry)] + log (e <o, [e^^")]) + 0{e') , 
where the residuum operator R{.) is given by 

Note that the quantity E_(o) [i?('7)] can be calculated on-the-fly using the coarse sim- 

ulation. Calculations involving the a posteriori error estimation and related adaptive 
methods will be discussed in a forthcoming publication. Earlier work that uses only 
an upper bound and not the sharp estimate of Theorem 12. 51 can be found in [313]. 

3. Cluster expansion and efTective interactions. In this section we expand 
the term E[e^'''''^"^'^'~^Af •^''^^jr;] in H2.22|l into a convergent series using a cluster 
expansion. 
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3.1. Introduction to the polymer model. It is convenient to choose an or- 
dering on the d-dimensional lattice Aj\/. For example, the lexicographic ordering 
defines for d = 2 the relation {ki,k2) < (^1,^2) if and only if ki < li or ki = li and 
^2 ^ h and then extended recursively for arbitrary dimension d. For later use, we also 
denote by Br{k) the ball centered at k of radius r for a given metric on the lattice. 
Furthermore, by I G B^{k) we mean that I G Br{k) n {I > k}. To set-up the cluster 
expansion we write the difference Hpj(a) — H^\ri) as 

HNia) - H^j\rj) - ^ Afe, J(a) , where (3.1) 

k<l 

AfeiJ(a):=-i {J{x~y)~J{k^))<j{x)a(y){2~5M). 

Note that we have excluded the external field contribution to the Hamiltonian, the 
role of which will be presented as a remark at the end of this section. In order to 
expand the exponential e^'^'^"''^^"^*' '''^^ into a series we set 

A;(a):=e-'^^-^(-)-l (3.2) 

and obtain, using the factorization properties of Pis[{d(T\ri) 

E[e-^(«~M-<'('')|r,]= j\{{l + fM)\{~Pk{da). (3.3) 

k<l k 

We give a short description of the polymer model that we will use in order to 
organize the cluster expansion. The product nfc<i(l + fki{(^)) can be expressed 
X^GeSj/ n{fc i}eG /fc'' '^'icre Qm is a collection of all simple graphs on M = 
m'^ vertices, i.e., graphs where each edge appears only once, with additional loops 
(fc, k) on the same vertex. A one-dimensional example of an element G is G = 
{{1, 2}, {2, 2}, {2, 5}, {3, 6}} which corresponds to the term /12/22/25/36 in the above 
sum. We observe further that each G can be divided into connected non-intersecting 
components called polymers, where by non-intersecting we mean that they do not 
share the same coarse cells. We define the support supp (7) of a polymer 7 the set 
of the coarse cells participating in it. In the previous example, G = (71,72) where 
7i ~ {{1, 2}, {2, 2}, {2, 5}} and 72 = {{3, 6}}. We also say 71 is incompatible with 72 
and we write 71 7^ 72 if supp (71) fl supp (72) = 0. Then H3.3|l is equal to 

jnh E n n h^\{hid.)= 

n>0 i'yl^-■■r^l^) i^l {k,l]^'ii k 

E n/ n n ~p^^^<^)^ (3-4) 

n>0 (7i,....7„) 4=1 {/c,i}e7i {/c}eSUpp (7i) 

since the polymers 71, . . . , 7„ do not share the same coarse cells. Note that the factor 
^ takes into account the fact that by relabeling the connected polymers 71 , . . . , 7„ 
we get the same G. 

An equivalent formulation is to consider as our building blocks the more funda- 
mental (than the polymers) clusters i? C Am (i.e. the set of vertices appearing in each 
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polymer). For example, the corresponding cluster to 71 is i?i — {1,2,5}. Note that 
to each cluster there are several polymers that correspond to it. To prevent confusion 
we warn the reader that what we call clusters i?, it is called polymers in I^. We use 
the name cluster to distinguish it from the previous description of vertices with edges, 
that we have called polymers. Using clusters the expansion becomes 



where 



ri>0 (Hi,...,H„)eTi" 



m = / E n A-'(^) n /^fcCrf^) 



(3.5) 



{fe}G-R 



is called the activity of the cluster R. By 7?. we denote the space of clusters R C Am 
with \R\ = card(_R) > 1 and Gn is the set of generalized connected graphs on the 
set R. A generalized connected graph on i? is a collection of distinct subsets of i?, in 
which case the vertices of the generalized graph are the indices of the enumeration of 
the subsets, and any two subsets of the vertices of the graph are linked to each other. 
The edges of this graph are defined whenever the distinct subsets share a common 
element. For more details we refer to 23. Thus we are in the context of |21 Theorem 
2] and we can formulate our first lemma. 

Lemma 3.1 (Expansion of the Hamiltonian) . If for every integer r > 2, C, satisfies 
the condition 



sup J2 ic(^)i<'5' 

|H|=r 



(3.6) 



for some S such that snpi^fpf^ He7?,.HD{fc} |C(^)I 5; ^ 6 < \, then 

I H I = 1 ° 
- - 1 " 

hm iv) - 51? iv) -Y.^ -^(^1 , . . . , i?„) n c(^. 

n>l ' (-n.i,.-.,H„)e7i" i=l 

where 

1 

E,eG„n{,,}eg(l(^.,^.)-l) 
and Gn is the set of the generalized, connected graphs on {1, . 



(3.7) 



<^(i?i 



, Rn ) — 



, 71 = 1 

,n> 1 
n} and 



l{Ri, Rj) 



0, {R^ n Rj ^ 0} 

1, {R, n Rj = 0} 



Proof: The proof is the same as in j2.,, Theorem 2] given (|2.22() and the discussion 
preceding Lemma |3.1I For later use we repeat the main steps of the proof. For the 
series H3.7|l we have 



E ^1 E 

n>l ' (-Ri,....-Rp)eTi" 



,R-a)^C,[R,) 



E IC(i?)l + E;^ E 



(-Rl,...,-Rp)eK" 
HiCA,, 



0(i?i,...,i?„) J|C(^, 



--■.S, (3.8) 
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where for the first term (n = 1) we have 

J2 m)\<Mj2 sup J2 \m\<Mi6+Y,s^-'). (3.9) 

RGTI.RcAm r>l'=eAM Reiz.RDik} r>2 

For the second term {n > 2) using the estimate from |21 p. 526, (3.6)] we obtain 



n>2 ■ (Ri,....Rri)erL" 

Ri CA^,, 



(t>{Rl,...,Rn)llaR^) 



< 



5Z ^1 $Z S 

n>2 ' Rf^T^ (Ri R,i)eTL" 

-RCAjj 3Ri=R 



< 



(i?2,...,-R„)eK"-i 



cj){Rl,...,Rn)Y[CiR^ 

n 

0(i?i,...,i?„)nc(^ 



n>2 HeTi 



1=2 



< 



En , ^, „M 1 / 5 S 



HCA. 



2)!|i?|el^l. (3.10) 



Thus, 



s < M{5 + y: s^-') + ^4 e ( 2^irb ) + E -(^^y^') - (^-n) 

r>2 n>2 ^ ^ r>2 

which concludes the proof. □ 

3.2. The small parameter of the cluster expansion. In order to identify a 
smaU parameter we set 

Eki{x-y) ■- J{x - y) - J{k,l) . 
The expansion 1)3. 2|l suggests that the error depends on both (3 and 

sup sup \EM{x-y)\. 

This quantity can be evaluated more explicitly for the special choice of interaction 
potential defined in (|2.3|l . 

Lemma 3.2. Assume that J satisfies \2.'^) - \2.^) then the coarse-grained interac- 
tion potential J at the coarse- graining level q approximates the potential J with the 
error 



5 S 



ji-i 



|J(x-y)- J(fc,OI <2-|-^ sup \\VVix'-y 



(3.12) 



for both I ^ k and I = k. Proof: Using the properties of the potential V, we expand 
V into the Taylor series, 



V{z) = V{z') + {z- z').\7V{z') + 0{\\z ~ z'f ) 



16 



M.A. Katsoulakis, P. Plechac, L. Rcy-BcUot, D. K. Tsagkarogiannis 



Using the definition of J, ()2.3|l and setting z = x — y and z' = x' — y' , where x, x' £ Ck 
and y,y' G C;, we have 



i E E j^{i-~y)~i-'^y'))-VVi^i-'-y')) 



r" ^ ^ L^L 

x'eCkv'eCi 



i E E 0(\\^iix-y)-ix'-y'm 



„^u ^ ^ yl^ 

and using the estimate — y) — (a;' — ?/')|| < ||a; — a;'|| + — y'H < 2 niax{diam (Cfc)} ~ 
^ we obtain H3.12|l in both cases I ^ fc and Z = fc. □ 

Our goal is to construct higher-order corrections to the Hamihonian -ff^^^ based on 
the expansion (|3.7|) . First we check the condition (|3.6|) and identify the parameter 8. 
From the point of view of the cluster expansion theory we are in the high temperature, 
small activity regime because of the a priori estimate given by Lemma 13.21 on the 
coarse-grained approximation. Hence we expect the small parameter 8 to depend on 
the characteristics of the coarse-graining, in particular on the parameters q and L. 

Lemma 3.3 (Identification of the small parameter S). For ( defined in |5'.5|) . 
condition 1^3. 6]) holds with 

sup ^ I Eki(x~y)\ 

In the particular case of Lemma we obtain S f3^^-j^\\W\\oo, where q is the 
level of coarse- graining and L is the range of the interaction of the particles on the 
microscopic lattice. Proof: To check the condition (|3.6|l we follow the analysis 
proposed in [22]. We start with the r — 1 case 

sup J2 \C{R)\ = sup f \e-P^--'^^^ ~ l\pkida) 

.c((l)-,^„v.,u), 

where we have used the fact that |e° - 1| < |a|el°l and that e'3|'^""'('^)l ^ 0(1). For 
the general case r > 2 we have 



sup Yl 

keAni Re-R.,RD{k} 
|H| = r 



/En /'^'^(^) n ^^(^^) 



q&Gr {;i,;2}Gg 



{k}eR 



- 1)! ^ 



kGAM ^ ki=k,k'y 

k^^k^.^i^j 



E n ( 



-flAk^k^Ji'y) 



i=l 



, (3.13) 



where we have assumed R = {fci, . . . , fc^}. We divide by (r — 1)! because we can relabel 
k2, ■ ■ ■ ,kr. Note that by Gr we denote the set of all connected graphs in {1, 2 . . . , r} 
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which may have self-loops {j, j} for any combination of j = 1,2 ... ,r (from now on 
we simply call them loops instead of self-loops) . In the sequel we need the following 
estimate due to Lemma 13.21 we have that for a fixed k E Am 



iA„Jwi~(i)',-i,c(i)^o(2:;;iiivviu) 

which implies that 



sup V |AHJ(a)| <C, (3.14) 



''^^M l:l=ik 



for every a and with C - sup^.^^^ J2i:i^k I J2xeCk,yec, ^ki{x - y)\ or in the special 



d+l 



case of J given in terms oiV C ^t:~II^^ 

Now we denote by the set of graphs without loops and we describe by 
g ^ g'^ the corresponding graph g with loops such that g = if we remove all loops 
from g. We have 

J2 Yl (e-^'^^.'=.^(-)-l) = 

geGr {»,i}Gg 

= E n (e-'^^'=''=.-^(^)-l) I 1+ ^ n (e-'^^"^'"^^''^)-!)) . (3.15) 

We observe that for any G with supp (5") — r the terms in the parenthesis 
are bounded by 2^, since for every g ^ g° we have that Yl{i j}£g/gO P\^kikjJ{<^)\ < 1 
(after the choice we will make at the end of the proof) and the summation X]g~gO 

ELi (D = 2''-l many terms. Then, for the sum J2gO<zG° j}GgO (e"''^"'"^ -1) 
we can use the tree-graph equality (e.g., [22 [p. 5, Theorem 2]) to estimate the sum over 
connected graphs with respect to the sum over the corresponding maximal spanning 
trees. From [221 Theorem 2] we have that 

n (e"'^'^"-'^- 1) = 



g° J}egO 



n (-/^^fc.fc. •^(^)) [ dh... f dtr-l 



E 



comp. with 

i^-i . . . i^-i-ie->^(^i--'^'-i'*i>-^*'-i) , (3.16) 

where g'^ is a connected graph in {1, 2 . . . , r} without loops and t*^ is the corresponding 
tree graph. The summation is over all sequences Xi, . . . , Xr-i of increasing subsets of 
{1, 2 . . . , r} such that Xi = 1, X„ C Xn+i and |X„| — n that are compatible with . 
A sequence Xi, . . . , Xr-i is compatible with a given tree r'^ if, for all n = 1, . . . , r — 1, 
Xn contains exactly n — 1 links of r'^. We also say that a link crosses Xn if 

I S X„ and J ^ Xn or vice versa; then &„ is the number of links of which cross X„, 
and 

W^(Xi, . . . , Xr_i, ti, . . . , tr-l) = ^ il({«, j}) ■ • • tr-l{{l,]})fi/^k,k, Ji'j) , 

l<i<j <r 
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where 



tn{{i.j}) 



t„ G [0,1] , if {«, j} crosses X„ 



1 , otherwise 

Then from H3.14|l we obtain that 

W{Xi,...,Xr-l,ti,...,tr-l)< IP^klJia) 



l<k<l<r 



<rl3 sup |AfeiJ(a)| ^r/3C, 



fceA 



M l=l,l^k 

where C ~ ©(^-^^ || VV^||oo)- Thus, uniformly in Xi, . . . ,X,._i,ti, . . . ,t,.-i we have 
that 

g-W(Xi,...,X,_i,ti,...,t,_i) < gr/3C_ 

Furthermore, from (22j Lemma 4] we have that 

du... f dtr-i J2 ^i'' ■ ■ ■ ^'-r' = 1 ■ 

Jo Jo xi,...,x,_i 

comp. with tO 

This leads to the fohowing tree-graph inequality for the case of graphs with loops 



E n 



r 



< r 



E n 



-/SAfc.fc, J(<t) 



1) 



From (|3.14|) we have that for any tree t° 



E n iAfe,,fc,j(fT)i <c'-i 

= k , k2 , ■ . ■ ,k 



k^AM ki = k,k2,...,kr jy^-j-O 



Using the Cayley formula J^T^eT" 1 = '"'^ , we conclude that 



r/3C 



sup J2 IC(^)I < 2'--— — r'-2(^c')'-i 



kGAM ReTZ.B.Dik} 

\R\ = r 



Thus, we require 



so it suffices to consider S ~ 1| Vy||oo- D 
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3.3. Effective Hamiltonians and specific entropy estimates. In this sec- 
tion we use the results of Lemma 13.11 and 13.31 and expand the Hamiltonian Hm {'>]) 
around H^j^^ in powers of 6 by truncating the series (|3.7|) at the levels of the number 
of interacting clusters and of the length of the clusters. We obtain the series 



Hm{v) - 51? + Hi? + • • ■ + ^1?^ + MO{S) , 



and define the corresponding Gibbs measures by 



-^^^Adv) - ^e'P^<'(^^+-+"i''(^^^ PMidv) , (3.17) 



where p — 1,2, ■ ■ ■ and Z^j is the corresponding partition function. In the following 
proposition we derive explicit formulas up to the order 0{d^) and state the corre- 
sponding error estimates for the relative entropy. Higher order corrections can be 
computed in a straightforward although tedious way. For the sake of simplicity we 
restrict ourselves to the case d = 1, however similar computations and results are 
derived in any dimension. 

Proposition 3.4 (Corrections to H^m)- ™s ^''■'''^ error estimate 



Hm{v)^H^m\v) + MO{5). (3.18) 



Furthermore, the first and second order corrections to the Hamiltonian Hj^j are given 
by 

Hm in) = iv) + H^i^ iv) + H^i' iv) + MO{6') , (3.19) 

where 



keAM 

Jifki +fkifkk +.fki.fu +fkifkkfu)pkid^)Piid^) (3.20) 

kieBlik) 
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and 



2^ / fkk{cr)pk{d(T) / fki{<y)Pk{da)pi{da) 



2 



ifkh + fkkfkh + fkhfhh + fkkfkhfhh)Pk{d(j)pi^{da) X 

X / {fkh + fkkfkh + fkhfhh + fkkfkhfhh)Pkidcr)pi^{da) + 



EE E 

k h£B+(k)heBL{h)UB+{k) 



{fkhfhh + fkhfkh + fkhfhh + [■ • ■])Pkida)pi^{da)pi^{da) 
= h+l2 + h + h, (3.21) 

where [. . .] means the previous three terms with all possible combinations of loops. The 
corresponding relative entropy error is 

Proof: The error in H3.18|l is given by To get an error MO{S'^) we need to 

include the terms n = 1, r = 1, 2, i.e., 



R: |-R| = 1,2 



Similarly, for the MO{6^) error we need to include (|3.20|) together with the terms 
n = 2, r = 1, 2 and n = 1, r = 3 

H^i'iv) = -l E 0(i?i,i?2)c(i?i)c(i?2)- E ^(^)' 

«i.H2 _R:|_R|=3 

|H^| = l, 2,1 = 1,2 



where (/)(i?i,i?2) = if i?i n i?2 =0 and —1 if Ri D R2 ^ 0, which occurs when 
Ri = R2 = {k} for k e Am, in the case of \Ri\ = 1, i = 1,2. If = 2, i = 1, 2 we 
have that i?i — {fc, li} and Ri — {fc, Z2}. For the relative entropy error for Il'j^'^ with 
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p = 0, 1, . . ., we have 



1 2<?' 



where for the partition functions we have 

-zi^'E_(„ (3.23) 

Thus, for the different choices of p in given the fact that the estimates (|3.18(l 
and ()3.19fl are uniform in rj we get that 



Z 



fog^^fogE,,, e^-^'^f^""^) ^MO{SP+'), 
where p = 0, 1, 2. □ 

4. Numerical schemes for coarse-graining and a posteriori estimates. 

We conclude the proof of Theorem 12.41 by giving explicit formulas for the correction 
terms (|3.2(J|I and H3.21|l and estimating them with respect to the small parameter e. 
The corrections consist of combinations of fki = e~^'^''''^^'^^ — 1 for all k and I. Since 
the exponent — /3Afci J(cr) in (|3.2|l is small we have that 

g-/3A.,JM _ 1 ^ ^ _(_/3A,,j(^))P with AkiJia) ^ 0{q^'' j^WVVU) . (4.1) 

The key point of our calculations relies on the cancellation 

AkiJ{cr)pk{da)pi{da) = , (4.2) 



following from the definition of H^j^ in (|TT7I) . 

In order to keep expressions simple we express our results in terms of the variables 
a{k), the number of spins <7{x) = 1 in the coarse cell Ck), and uj^k) — q — a(k). Next 
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we define the following quantities 

Ei{a) ~ E[a{x)\a] = (4.3) 

q 

E2{a) := E[a{x)a{y)\a] - ^ q{q - 1) ('^'^^ 

Esia) ■.^E[a{x)a{y)a{z)\a] = 

_ a{a - l)(a - 2) - 3a(a - f )cj + 3a{uj ~ l)w - (tj - 2){uj - l)uj 

~ '7(<z-i)(g-2) ^ • ^ 

£;4(a) := E[cr(a;)cr(y)cr(z)|a] = 

_ a{a - l){a - 2){a - 3) - 4a(a - l)(a - 2)uj 
~ q{q-l){q-2){q-3) + 

6a(a - - - 4a(a) - 2)(w - l)uj + uj{lu - 1){lu - 2)(w - 3) 
+ q{q - l){q - 2){q - 3) 

which are all of order 0{1). Furthermore, we introduce the notation 



■(4.6) 



Jkl 



J2iJix-y)-J{k,l)r (4.7) 
^ {J{x~y)^J{k,l)){J{x~y')-J{k,l)) (4.8) 
Jtfe.fc3:= E (./(^-y)- J^(A:i,/c2))(J(2/-z)- J(fe,/C3)) (4.9) 



,2 



If fci = ^2 then we also impose that for x,y € Ck-^ we have y ^ x. 

Note that these quantities have various symmetries, for example, jff. = j^i or 
jkl ~ jk-i ^ Ji-k some function and similarly depends also only on |fc — Z|, 
moreover j^^^.^^^ = jl.^k^M-k,.- 

Based on (|2.18|l we get first estimates in terms of q and L 

2d+2 / a \ 2 , / (7 \ 2d+2 , / n \ 2d+2 



•^^^ \l) ' ^^i^ VL'^+i/ VL/ ' ^kik2k3^q 



(!)■ 



Proof of Theorem 12. 4t Starting from the formulas for i/j^-' and h'^^ in Proposi- 
tion we expand the factors fki and re-estimate the corrections using the cancella- 
tions in (|4.2|l . RecaUing that e ~ -^/^H VF||oo, we have 



(i) E /Afc('T)P.(rfO-M(g^''-^/3||Vy|U)'^A/g2^( 

fceAM 

(ii) EE/ (-^^ + /fci/fcfc + fkifii)Pkidcr)pi{da) ^ 

k l£BL(k) 



a\2d 

1] e2 
L 



.9 

while the term involving fkifkkfii is of a higher order 
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Therefore it suffices to include only the first two contributions which we also 
compute explicitly. With a slight abuse of notation we still denote the new terms by 
H^M ■ Collecting all the terms gives us 



-ijW =/3^ / i(AfefeJ(a))2pfe(da)+/3^ / U/\kiJ{.o)f~Pk{da)~pi{da) + 

k kKl-' 

+ [ \^kkJ{cT)AkiJ{a)pk{da)pi{da) + 

k<l 

+ /3^ fAkiJ{a)^AuJ{a)ph{da)pi{da). (4.10) 

k<l •' 

Explicit calculations of these integrals are detailed in Appendix A, yielding 

-^M = f E^Jfefe [-EA{a{k)) + E^{a{k))] + 2ji, [E^{a{k)) + 1 - 2E2(a(fc))] + 

k 

+ f Ej« mo^mMc^ii)) - E2H1)) - E2{a{k)) + 1)] + 

k<l 



jI [-2E2{a{k))E2{a{l)) + i?2(a(fc)) + E^iail))] + 



+ f E^jtw [-E^{a{k))E,{a{l)) + E,{a{k))E,{am + 



k<l 

+ f E2j«/c [~EM{l))Ei{a{k)) + E^{a{l))E,{a{k))] . 

k<l 

Since jl^i = jf^, this expression further simplifies to 
- = f E^ifefe [-EA{a{k)) + E2{a{k))] + 2jl [E,{a{k)) + 1 - 2E2(a(fc))] + 

k 

+ f EJ« [E2{a{k))E4a{l)) - E^{a{l)) - E^{a{k)) + 1] + 

k<l 



+ jl [-2E2{a{k))E2{a{l))+E2{a{k))+E2{am + 



+ f E ^Iki [-Es{aik))Eiiail)) + 2E^{a{k))E^{a{l)) 



k,ljtk 

- Es{a{l))Ei{a{k))] . 

By the estimates on the terms jli and the fact that the terms Ei{a) are of order one, 
and by counting the summations we obtain 

2 /L^'^ 



hence we have gained an extra g'' as compared with the previous estimate. In the 
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same spirit we estimate the terms of the correction H^^^ . From H3.21|l we have 

4 / T \^ / n \4 



OC I 5 



Obviously, for H^/ it suffices to consider only the term I4. Abusing slightly the 

— (2) 

notation we call this term H^j and we calculate it explicitly 

fci k2>ki k3>k2 

^k2k3J{cr)Ak3ki J {o-)Pk2 {d<j)pk3 {dcr)pki {da) + 



+ J l^k3kxJ{<y)l^kik2J{(^)PkAdcr)pki{d(j)pk2{da) 
Similarly, as for the previous term, we evaluate the integrals in terms of Ek and obtain 

ki k2>ki k^>k2 

jtfe.fe3(-^i("(^i))^2(«(A;2))i?i(a(fc3)) + i?i(«(A;i))i?i(a(/c3))) 
+4fc3fc.(-^i("(^2))i?2(«(A:3))i?i(a(fci))+£;i(«(fc2))i?i(a(/ci))) 
+Jl3feife.(-£^i(«(^3))i?2(«(fci))£;i(a(fc2))+£;i(a(/c3))i?i(a(/c2))). 

Using the estimates above we obtain the order of the correction 

2d 

q) VL'^+i' 

Thus, from the above we deduce two results: the first one that due to the fact 
that the leading order terms that participate in the 0{6) error vanish, the choice of 
the initial Hamiltonian H^j^ yields a second-order accurate approximation, in other 
words 

The second one is that to obtain a 0{e^) error, the corresponding correction term 
have to include both H^j^ and H^^^ . In such a case we obtain 



N 



HM-{H'M'+H):/+K/))-0{e^). 



In the same spirit we can derive error estimates for the additional terms in the ex- 
pansion. □ 

In SectionElwe discuss the computational complexity of higher-order terms. Here 
we present only two schemes that are relevant for practical implementations. 

Scheme 4.1 (2nd-order coarse-graining). The 2nd-order coarse- graining algo- 
rithm has the following characteristics 
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1. Hamiltonian: H^j , given by \2.1'l\l . 

2. Gibbs measure: /i^f''^, given by J^y. for p — 1. 

3. Relative entropy error 

^(/^M,/3lMiv,/5oF-i)^0(e2). 

Scheme l4.1l is the coarse-graining algorithm that has been extensively studied in 
| 13l 1151 1141 [T7| . The novelty presented in this paper is the sharper error estimate 
that shows that the error is of the order 0{e^); this estimate readily follows from the 
cancellation due to (|4.2|) as is seen from the calculations above. 

Scheme 4.2 (3rd-order coarse-graining). We construct a higher-order Monte 
Carlo algorithm with the following characteristics 

1. Hamiltonian: H^f^ -\- H^j^ + H^j^ ,where the corrections are 

^ Y^AjI^ [~Ei{a{k)) + E2{a{k))+] (4.11) 

k 

+2jI [E,{a{k)) + l-2E2{a{k))] + 
+ f T^^li [E,{a{k))E2{a{l)) - E^iail)) - E^iaik)) + 1] + 

k<l 

[-2E2{a{k))E2{a{l)) + E^iaik)) + E2{am + 
+ f E [-EM{k))E^{a{l)) + 2E^{a{k))E,{a{l)) - 

k,l^k 

- E^{a{l))E^{a{k))] . 

fci k2>ki k3>k2 

ifeife.fc3(-^i(«(fci))^2(a(fc2))i?i(a(fc3))+i?i(a(fci))i?i(a(fc3))) (4.12) 
+jtfe3fei(-^i("(fc2))i^2(a(A3))i?i(a(fci)) + i?i(a(/c2))i5i(a(fci))) 
+ifc3feifc2(-^i("(^3))i?2(a(fci))i?i(a(fc2)) + i?i(a(fc3))i5i(a(fc2))). 

The terms Ei are defined in i4.Si4-(>}) o,f^d the quantities fkiT Jki^ itik^ks ^'^^ 
defined in \4-. ^1\4-^ - 

2. Gibbs measure g{dr]) — -^c^^^m^ ^^ii PM{drj) . 

3. Relative entropy error 

^(MM,/3lMJV,/5oF-i)^0(e3). 

Remark 4.1. The estimates in Scheme f4. II and Scheme [4.21 refer to the equilib- 
rium Gibbs states of lattice systems. Non-equilibrium models such as the Arrhenius 
dynamics can be coarse-grained as shown in |13[ [T5] . In this case it is also possible to 
carry out a detailed error analysis between the exact microscopic and the approximat- 
ing coarse-grained dynamics. In [141 an order Oie) estimate was proved for the specific 
relative entropy between microscopic and coarse-grained dynamics, while in 17 an 
improved 0{e^) estimate was shown in the weak topology. Both results are analogous 



and 
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to Scheme 14.11 as the invariant Gibbs measure corresponding to the coarse-grained 
Arrhenius dynamics studied there is (|3.17|l . 

We now turn our attention to the a posteriori error estimate in Theorem l2.5l The 
terms derived in Scheme 14.21 and the error estimate of Theorem l2 . 41 provide an exphcit 
way of calculating the error made by the 2nd-order coarse-graining. 

Proof of Theorem l2.51 As we have seen in ProDOsition l3.4l we can write the relative 
entropy error as the expectation with respect to the coarse-grained measure of some 
quantities, namely of the difference Hm ~ h'^m ^"^y choice of K. On the other 
hand, in the Scheme 14.21 we have calculated explicitly the terms that contribute to 
the error of W e now conclude the proof by recalling the proof of Theorem 12.41 

and relations and □ 

Using a Metropolis Monte Carlo sampler (see Appendix B), we can numerically 
compute the expectations in H3.22|l and H3.23|l and thus we can calculate the a pos- 
teriori error of TZ{jlfj ^\fiN,fj ° F^^). Note also that as a consequence the quantity 
E_(o) [i?(?7)] can be calculated on-the-fly using the coarse simulation only, at least up 

to the error 0{e^) according to Scheme 

4.1. Coarse-graining of external fields. To include the external field in our 
analysis, we define an effective external field h by 

e-mrm)^_}_f e-'^^-^^"(^)^(")p,(da). (4.13) 

for every k. Then the effective full Hamiltonian (for both the interaction and the 
external field contribution) will be given by 

P[V) J{F(a)=r,} 

and by perturbing around the coarse-grained Hamiltonian H^^j +X]fc ^ivi^)) ^6 obtain 



k 

_ i log 4t / e-^^^e-''(S'= ^("W^-S-^EA H-)-(-))Pj^(da) , 

P PlV) J{F(a)=-n} 

where Ai/ = Hn-Hm- 

Since the part that involves the external field can be written 
in a product form, we obtain 



- log / e-^^" J] (^e^CHvm-i:.,a, H^M-)) ^^a] 



The new prior measure is normalized due to the definition (|4.13|l of the effective 
external field and therefore we can proceed with the cluster expansions as described 
before. Eventually, the only issue will be the analytic evaluation of the expected 
values E/i[(T(a;)|?7] with respect to the new prior measure due to the dependence on 
the external field. Furthermore, it is easy to see that in the case of a constant or 
slowly varying (at the same scale as the coarse cells) external field there is no extra 
contribution to the correction terms of the Hamiltonian. 
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5. Computational algorithms and numerical experiments. The 2nd-order 
approximation for the coarse-grained algorithm as described in Scheme [4. II has been 
extensively studied in previous works, see, e.g., |13II15[[T7] . where it has been demon- 
strated that it performs weU in certain regimes (e.g., long-range interactions). In this 
section we present numerical experiments based on Scheme 14.21 and its comparison 
with the 2nd-order coarse-graining Scheme l4.1l for cases where the latter does not give 
satisfactory results. 

Before we present numerical examples we briefly discuss the computational com- 
plexity of the approximations. As a simple measure of complexity we use the number 
of operations required for evaluating the Hamiltonian. Although the actual Monte 
Carlo step does not require evaluation of the full Hamiltonian the relative complex- 
ity with respect to the operation count of the full microscopic simulation g = 1 is 
properly reflected by this measure. Given a potential with the interaction radius L 
on a d-dimensional lattice with N sites, the number of operations for evaluation of 
the microscopic Hamiltonian Hm is 0{NL'^). The count for the 2nd-order approxi- 
mation nfj' on the coarse lattice with M sites and coarse-graining ratio q becomes 
0{ML'^ /q'^). The 3rd-order approximation H^j^ involves an additional summation 
over the interaction range and hence the operation count is 0{ML^'^/q^'^). In these 
estimates the ratio L/q is understood to be equal to one whenever q > L. In such 
a case the coarse interactions are reduced to the nearest-neighbor case. Thus the 
compression of the interaction kernel J in the corresponding approximations yields 
the speed-up of order Oiq'^'^) for i?^' and (D{q^'^/L<^) for h'}^\ We see that the 
3rd-order approximation gives an improved error estimate at the same computational 
cost whenever g = i, in other words, whenever we can compress interactions to the 
nearest-neighbor potential. 

We demonstrate the approximation properties in simulations of one-dimensional 
Ising-type spin systems. The one-dimensional system provides a suitable test bed 
since the exact (analytical) solutions are known for both the classical Ising system 
(i.e., nearest-neighbor) and the mean- field model (Curie- Weiss model). We use the 
exact solutions to ensure that the simulations are not influenced by finite-size effects. 
In all figures the exact solutions visually coincide with the fully resolved simulations, 
i.e., <7 = 1. We computed error bars for statistical post-processing, however, they are 
not displayed in the figures due to their small relative size as compared to the scales 
of figures. 

In the case of nearest-neighbor interactions the one-dimensional system does not 
exhibit phase transition. In fact, the exact solution is given by a well-known formula 
(see, e.g., ^Hl), which we adopt to our choice of Hamiltonian with the constant nearest- 
neighbor (L = 1) interaction potential of strength Jq. The equilibrium magnetization 
curve is then given by 



On the other hand, for infinitely long attractive interactions there exists a 2nd- 
order phase transition and hysteresis behavior is observed according to the global 
mean- field theory for /3 > /3c, [HI- More explicitly, the mean- field (Curie- Weiss) model 
gives the magnetization curve as a solution of the non-linear equation 




sinh(/3/i) 



(5.1) 




h = l3Janif3 - — log 



mf3 



(5.2) 
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The Curie- Weiss model exhibits phase transition at the critical temperature given by 
PcJo — 1 in the case of spins { — 1, 1} {PcJo — 4 for spins {0, 1}). 

The approximation of the hysteresis behavior in coarse-grained simulations pro- 
vides a good test for derived coarse-graining schemes. It has been observed previously 
that hysteresis and critical behavior are not captured properly for short and inter- 
mediate range potentials, Similar issues in predicting critical behavior were also 
observed in (21, for coarse-graining of complex fluids. There an artificial solidification 
effect was observed for higher levels of coarse-graining. 

In the numerical tests presented here we demonstrate that the derived corrections 
improve this behavior even in the case of nearest-neighbor interactions or high coarse- 
graining ratio q. The sampling of the equilibrium measure is done by using microscopic 
and coarse-grained Metropolis dynamics discussed briefly in Appendix B. We compute 
isotherms similarly to natural parameter continuation, i.e., we trace the magnetization 
m/3 vs. external field h, first upon increasing the field h from low values and then 
decreasing it from high values. All simulations have been done with the fine lattice 
of the size = 512. As derived in Section rOl the errors depend on the interplay of 
three parameters q, L and /3. In examples presented here we investigate approximation 
properties for some regimes in this parameter space. In the computational examples 
we choose J to be constant on its support of the size 2L, in particular J{x) — for 
\x\ < L and otherwise. 

Test Case I: short-range interactions. We use the classical Ising model with nearest- 
neighbor interactions to show efficiency of the 3rd-order correction term. Figure I^TT 
15 .21 depicts simulations at two different temperatures P — 2,3. The 2nd-order approxi- 
mation exhibits hysteresis behavior for /3 above the critical value Pc for the Curie- Weiss 
model. It partly follows the magnetization curve predicted by the mean-field theory. 
Including the corrections into the effective Hamiltonian removes the hysteresis and 
in the case of smaller /3 gives even a reasonable approximation to the exact solution, 
which coincides with the case q = 1 at the scale of the figure. 

Test Case II: intermediate-range interactions. In this case the system exhibits hys- 
teresis behavior (and a 2nd-order phase transition) but the correct approximation of 
the transition between two states is not achieved by the 2nd-order effective Hamil- 
tonian. In Figure 15.315.41 we present an example with extreme coarse-graining up to 
the interaction range, i.e., q — L — 8, and beyond the interaction range q = 32. Note 
that this example is far from the e ^ j- limit suggested by Lemma ISTI However, 
as is the case in most asymptotics, computations perform well even for larger values 
of e and especially in this case where the higher-order corrections are added. 

Test Case III: long-range interactions. If the interaction range L is sufficiently large 
the behavior of the system is well-approximated by the mean-field solution and coarse- 
grained simulations will give good predictions already in the 2nd-order approximation. 
This is observed in Figure 15.715.81 with coarse-graining to the range of interactions 
q ~ L ^ 32. However, coarse-graining beyond the interaction range {q = 64 in 
Figure shows that the 2nd and 3rd-order schemes give almost identical results. 
On the other hand the simulations in Figure [^. 515 . 61 show two regimes where the 2nd- 
order approximation gives reasonable agreement with the microscopic magnetization 
curve. 
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Appendix A. In this section we present the detailed calculations involved in 
obtaining exact formulas for the corrections p = 1,2,... to the coarse-grained 
Hamiltonian Computation of the term J{AkkJ{<^))^Pk{d(j)- Using the definition 

of Afefe J we write 

= E E {J{x-y)-J{k,mJ{x' -y')-J{k,k))E[a{x)a{y)a{x')a{y')\a]. 

In the above formula the expectation takes different values according to the following 
cases 

1. Four particles: x ^ x' ,y' and y ^ x' ,y' , in which case the expectation gives 

£■4(0;). 

2. Three particles: x = x' and y ^ y', or y = y' and x x' , 01 x = y' and 
x' ^ y, 01 x' = y and x ^ y', in which case for some distinct x, y, z we obtain 
E[a^{x)(T{y)a{z)\a] = E[a{y)a{z)\a] = E2{a), since a'^{x) = 1. 

3. Two particles: x = x' and y = y', or x = y' and x' = y, which for the distinct 
particle positions x,y gives E[(T^(a;)cr^(y)|a] = 1. 

We also keep in mind that we already have that y ^ x and y' ^ x' . With the above 
cases we can substitute for E\a{x)a(%))a{x')a(\)'y\oi\ the expression 

(1 - ^x,x')i}- - <5a:,j/')(l - ^V,x'){"^ - Sy,y') X E4{a) + 

+ - Sy,y') + Sy,y'{l " 5x,x') + ~ ^x' ,y) + Sx',y{'^ " Sx,y')] X E2{a) + 

,x'^y,y' "I" ^x,y'^x',y 

) X 1 . 

We expand the above products and collect the terms with the factor d^^x' (note that 
the others with the factors d^^y' etc. are same by changing variables), and with the 
factor 5x,x'Sy,y' and we obtain 



4 E E {J{x-y)-J{k,k)){J{x' 

= 4jl,{-E4{a)+E2{a)), 

2 ^ {J{x-y)-J{k,k)){J{x' 

= 2jl^{E^{a) + 1 - 2E2{a)) , 



-y') - J{k,k))5x,x,{-Ei{a)+E2{a)) = 
- y') - J{k,k))6x,x^Sy,y^{E4, + 1 - 2E2) = 
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Computation of the term J{Ai.iJ{a))^pi.{da)pi{da). Similarly as in the calculation 
above we consider all possible cases for the position of the particles and we obtain 

J2 E (-^(^ - 2/) - J{k, mJ{x' - y') - J{k, l))E[a{x)a{y)a{x')a{y')\a] = 

v'^'^i y'ec, 
y^^i y'ec, 

X {(1 - - Sy^y-)E[a{x)<j{x')\ak]E[<j{y)<j{y')\ai] + 

+ S^.^'il - Syy)E[a^x)\ak]E[<j{y)<j{y')\ai] + 
+ Sy,y,{l - S,,,,)E[a{x)<j{x')\ak]E[a^{y)\ai] + 

+ S^,^,6y,y>E[a\x)\ak]E[a\y)\ai]} = 

= E E (■^(^-y)--^(^'0)(-^(^'-2/')--^(fc,o)x 

X {S:c,x'{-E2{ak)E2iai) + E^iai)) + 5y,y>{-E2{ak)E2{ai) + E2{ak))+ 

+ Kx'^v,v'{E2{ak)E2{ai) - E2{ai) - E2{ak) + 1)} = 

= 3li{-2E2{ak)E2{ai) + E2{ak) + E2{ai)) 
+ jli{E2iak)E2{ai) - E2{ai) - ^sK) + 1) 

Computation of the term J AkkJ{cr)AkiJ{o')pk{d<T)pi{da). In the same spirit we have 
E E (-^(^ - - •^('^' ^))('^(^' - y') - ■^(^' mHx)a{y)a{x')a{y')\a] = 

y'eCi 

{(1 - ^.,x')(l - (5^,x')E[<7(a;)a(2/)a(a;')|afe]E[c7(y')|a;]+ 
+ 5:,,^,E[c7\x)a{y)\ak]E[a{y')\ai] + 5y,^,E[cj{x)a^{y)\ak]E[a{y')\ai]} = 
E E {J{x-y)-Jik,k)){J{x'-y')-J{k,l))x 



X 



X { - ,5,,,, (i;3(afc)i;i(a;) - Et{ak)Er{ai)) - 
- by,^, {E3{ak)Ei{ai) - Ei{ak)Ei{ai)) } = 
= -2jl^i{E3{ak)E,{ai) - Ei{ak)E,{ai)) . 

Similar computation yields expressions —2jfi^{E3{ai)Ei{ak) — Ei{ai)Ei{ak)) for the 
terms fufki- 
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Computation of the term j lS.k^k^J{a)/S.k2HJ{^)Pki{d<j)pk2{'^^)Pk3{d<j)- We repeat 
the same procedure and obtain 

^ ^ {J{x -y)~ J{h,k2)){J{x' - y') - J{k2,k3))E[a{x)a{y)a{x')a{y')\a] = 
^ J2 {J{x~y)-J{k,,k2)){J{x'-y')-J{k2,k3))x 

X |(1 -5j,,,0E[(T(2;)|afcjE[(7(2;)(T(x')|afcJE[a(j/')|afc3] + 

+ ,5j,,,,E[a(a;)|afeJE[a(y)2|afeJE[(T(y')l«fc3]} = 
E (^(^-y)- J^(^i,^2))(J(x'-2/')- J^(^2,A:3))x 

X (5y^^/(-£;i(afej£:2(afe2)-E^i(a*;3) + Ei(aki)Ei(ak3)) = 
= il^k2k-A-Ei{ak^)E2{ak2)Ei{ak.,) + Ei{ak^)Ei{ak3)) . 

Appendix B: Sampling of the equilibrium measure. In this section we 
briefly describe the background of Monte Carlo methods used in Section [3 for the 
sampling of the microscopic and coarse-grained equilibrium Gibbs measures. These 
algorithms rely on the construction of a suitable Markov Chain such that its unique 
invariant measure is the Gibbs measure we intend to sample. 

Microscopic Monte Carlo algorithms. The sampling algorithm for the microscopic 
lattice system is given in terms a continuous-time jump Markov process that defines a 
change of the spin a{x) with the probability c(x, cr)Ai over the time interval [t, t + /S.t\. 
The function c : Aa? xSn ^ M is called a rate of the process. The jump process {<Jt]t>o 
is constructed in the following way: suppose that at the time t the configuration 
is Ut, then the probability that over the time interval [t,t -f Af] the spin at the 
site a; G Ajv spontaneously changes from 174(2:) to a new configuration <^t+/^ti^) 
c{x,a)/S.t -\- O(At^). We denote the resulting configuration cr^. We require that the 
dynamics is such that the invariant measure of this Markov process is the Gibbs 
measure (12. 5|) . The sufficient condition is known as detailed balance and it imposes a 
condition on the form of the rate 

c(i:,cr)e-'3^"('^) = c{x,(j^)e-P"''^''^'> . 

This condition has a simple interpretation 0(2:, a) is the rate of converting <7{x) to 
the value cr^(a;) while c{x,cr^) is the rate of changing the spin at the site x back to 
cr{x). The widely used class of Metropolis- type dynamics satisfies the detailed balance 
conditions and has the rate given by 

c{x, a) = G{l3A,HN{a)) , where A^H^ia) = Hn{>j-) - ffjv(fT), 

where G is a continuous function satisfying: G{r) ~ G{~r)e~'^ for all r e R. The 
most common choices in physics simulations are G(r) — (Glauber dynamics), 

G(r) = e~['"l+, (Metropolis dynamics), with [r]+ = r if r > and = otherwise, 
and G(r) = e"""/^. Such dynamics are often used as samplers from the canonical 
equilibrium Gibbs measure. 
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Coarse-grained Monte Carlo algorithms. For the purpose of sampling the coarse- 
grained Gibbs measure given by p,M,f3i'>]) '^iU consider a Markov jump process 
with the rates Cb{k,r]),Cd{k,r]) correspond to the addition ("birth") and removal of a 
particle ("death") respectively, from the coarse cell The resulting process is a birth- 
death process {77t}t>o defined on the state space E"^ = {— q, —q + 2,..., +q} or = 

{0,1, ...<?}. 

As in the case of microscopic dynamics, we need to ensure the detailed balance 
condition for the coarse-grained rates expressed as 

Cb{k, v)P'M,p{v) = Cd{k, 7] + Sk)llM,i3{v + 4) 
Cd{k,ri)fiM,f3{Tl) = Cb{k,r]- 5k)iXM,f3[ri - 4) ■ 

For the Metropolis-type dynamics the rates are given by 

-cdk,ri) = G(i/i?(ry + 4) - H^^^{ri)){q - vik)) , 
Crf(fc,77) = G(5i?(77 - 4) - H^i\v))vik) ■ 

Notice that with these rates the detailed balance conditions hold since 

GiH^^Hv + 4) - i/i?(r;))e-<'('') = G(ijl?(, - 4) - i/l?(,))e-^- ("+^^) , 
G{H^^\, - 4) - ^(r;))^-^'^) = G{H^(^) - <(, - 4))e-<'("-^^) 

and G{r) ^ G(-r)e-'' for all r G M. 

Higher-order coarse-grained Monte Carlo algorithms. In Theorem 12.41 we have sug- 
gested higher-order corrections {H^\ for p — 1, . . .) to the coarse-grained Hamiltonian 

Based on this equilibrium theory, and on the detailed balance condition, we 
define rates that are capable of sampling the corrected Gibbs measure corresponding 
to In this case the Metropolis-type rates are given as 

ciP\k,rj) = G(i/1?(77 + 4) - i?l?(r/))(g - v{k)) 
cf\k,rj) = G{H^^{^ - 4) - H^ij^viM) ■ 
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Magnetization: interaction L=1 , Jj^=1 , p =2 (mean field: = 1 ) 




h - external field 

Fig. 5.1. Comparison of fully resolved q = 1 and coarse-grained q = 8 simulations. The 
interaction range is L = I and the inverse temperature is fixed at /B = 2. 



Magnetization: interaction L=1 , Jj^=1 , p =3 (mean field: = 1 ) 




h - external field 

Fig. 5.2. Comparison of fully resolved q = 1 and coarse-grained q = 8 simulations. The 
interaction range is L = I and the inverse temperature is fixed at /B = 3. 
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Magnetization: interaction L=8, Jg=1 , p =2 (mean field: = 1 ) 
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Fig. 5.3. Comparison of fully resolved q = I and coarse-grained q = 8 simulations. The 
interaction range is L = 8 and the inverse temperature is fixed at (3 = 2. 



Magnetization: interaction L=8, , p =2 (mean field: P^, = 1 ) 




ti - external field 

Fig. 5.4. Comparison of fully resolved q = 1 and coarse-grained g = 32 simulations. The 
interaction range is L = 8 and the inverse temperature is fixed at (3 = 2. 



36 



M.A. Katsoulakis, P. Plechac, L. Rey-Bellot, D. K. Tsagkarogiannis 



Magnetization: interaction L=8, Jg=1 , p =2 (mean field: P^, = 1 ) 




-0.5 -0.4 -0.3 -0.2 -0.1 0.1 0.2 0.3 0.4 0.5 
ti - external field 

Fig. 5.5. Comparison of fully resolved q = 1 and coarse-grained q = 8 simulations. The 
interaction range is L = 8 and the inverse temperature is fixed at /B = 2. 



Magnetization; interaction L=8, Jp=1 , p =1 (mean field: = 1 ) 
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Fig. 5.6. Comparison of fully resolved q = 1 and coarse-grained q = 8 simulations in the "high 
temperature" regime. The interaction range is L = 8 and the inverse temperature is fixed at (3 = I. 
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Magnetization: interaction L=32, Jp=1, p=2 {mean field: = 1) 
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Fig. 5.7. Comparison of fully resolved q = I and coarse-grained q = 32 simulations. The 
interaction range is L = 32 and the inverse temperature is fixed at [3 = 2. 



Magnetization: interaction L=32, Jp=1 , p =2 {mean field: = 1 1 



0.8 


1 

1 

1 
1 




'' 1 


0.6 


j 
1 

1 




I 

i / 
1 / 


0.4 


1 
1 

i 




A 


0.2 


1 
1 






V 


1 
i 

i 




\ 
1 


-0.2 


1 

1 




/ 


-0.4 


1 




! 


-0.6 


/I 






-0.8 


1 

V 1 






q=64 

q=64 corr 
Curie- Weiss 





-0.5 -0.4 -0.3 -0.2 -0.1 0.1 0.2 0.3 0.4 0.5 
ti - externai field 

Fig. 5.8. Comparison of fully resolved q = I and coarse-grained g = 64 simulations. The 
interaction range is L = 32 and the inverse temperature is fixed at [3 = 2. 



